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ABSTRACT 

An  efficient  recursive  enumeration  procedure  is  described  for  finding  the 
complete  family  of  efficient,  or  undominaled,  solutions  tor  general  separable 
multidimensional  "knapsack"  problems.  A generalization  of  the  Gi Imore-Gomory 
procedure  provides  an  alternative  view  t>f  the  Morin-Marsten  method  that  admits 
an  algorithm  requiring  significantly  less  computer  storage  and  computational 
overhead.  We  illustrate  the  procedure  with  a highly  nonlinear  example. 


I . I III  I IkIiII  I I III! 


Ill  this  jtapiT  we  ilcvclop  .in  .1 1 )>(>r  1 1 hiii  loi  griic  1 .1 1 1 iik  tlic  1 uinp  I cl  (<  set  nl 
elticiciit,  or  iimioiiii ii.iLeil , solutions  for  the  gcncr.il  scp.i r.ili I c nonlinc.ir 
integer  progr.immi iig  |>rulileiii; 

(P)  max  {r(x);  g(x)  ' h,  n < x 11,  x integer}, 

where  x,  the  vector  of'  lower  houinis  11,  ami  the  vector  of  iippi'r  hounds  u are 

all  II  x 1,  and  h is  111  x 1.  The  return  tiimtion  r(x)  ~ 1 r.(x.),  .1  = jl,  2, 

ji.J  •'  ' 

n},  and  the  resource  consumption  vector  g(x)  = |gj(x),  g.,(x),...,  g^^(x)|', 

where  each  g.(x)  = 1 g (x  ),  it:l  = {l,2,...,m}.  We  reipiire  only  that  the 
‘ jfj  J 

consumption  functions  satisfy  the  condition: 

No  assumptions  on  the  nature  of  the  return  functions  r.lx^)  are  required.  We 
refer  to  condition  (1.1)  as  the  knapsack  condition. 

Any  feasible  solution  x is  said  to  he  inefficient  or  dominated  if  there 
exists  an  alternative  feasible  solution  x such  that: 

r(x)  > r(x)  (1.2) 

and  g(x)  < g(x) , ( 1 .3) 

with  at  least  one  strict  inequality  holding  in  (1.2)  and  (1.3).  Then  x is 
said  to  dominate  x.  Otherwise,  x and  x are  s.iid  to  he  miitually  uiidominated . 

If  (1.2)  and  (1.3)  are  satisfied  with  strict  equality,  then  x and  x are  said 
to  be  equivalent. 

t Alternative  approaches  for  solving  numerous  v.iriants  and  specialized 

I 

sub-classes  of  (P)  are  widely  represented  in  the  literature.  We  use  as  a 
point  of  departure  here,  however,  the  excellent  paper  by  Morin  and  Marsten 
; lift}.  The  Morin-Marsten  paper  was  the  first  to  provide  a unified  framework 

‘ demonstrating  that  the  "curse  of  dimensionality"  commonly  attributed  to 


classes  of  mu  1 1 i <1 1 niciis  loii.i  I coinhiiialorial  opl  iiiii/at  ion  problems.  Altliou^li 
more  etticieiit  melliu<ls  lor  solving  (l‘)  exist  |lf>|,  the  pro('<‘ihii  e in  |IK|  is 
the  only  parametrii  met  hoilo  I ogy  availalih*  lor  generating  I lie  entiie  set  ol 
efficient  solutions.  An  excellent  review  of  the  utility  ol  the  numerous 
special  forms  of  (P)  in  a wide  range  of  thorelical  and  ajiplied  problems  in 
lineal  and  integer  programming  can  also  be  found  in  |18|;  the  reader  is 
referred  there  for  details.  We  do  note,  however,  that  some  interesting  non- 
separable  variants  of  (P)  have  also  appeared  with  jiarticular  applications  in 
finance  ( 8 ) . 

In  §2  we  describe  a set  of  simplifying  transformations  which  will  reduce 
(P)  to  an  equivalent  problem  in  which  the  g^j(*)  and  j ( ' ) functions  are 
everywhere  nonnegative.  This  extends  the  Morin-Marsten  procedure  to  a broader 
class  of  problems.  In  §3  we  utilize  a recursive  enumeration  approach  to 
provide  a significantly  simpler  derivation  of  the  basic  procedure  of  [18],  and 
provide  proofs  of  the  fathom  by  infeasibility  and  fathom  by  dominance  rules 
that  do  not  appear  in  the  original  paper.  In  §4  we  describe  a computer 
implementation  requiring  significantly  less  storage,  and  the  maintenance  and 
manipulation  of  far  less  bookkeeping  machinery,  than  that  presented  in  |18|. 
This  can  be  particularly  important  when  m and  n are  of  realistic  size,  since 
the  efficient  set  is  then  normally  quite  large.  An  illustration  of  the 
implementation  is  presented  in  §5. 

2.  Simpl i f i cat  ions 

The  algorithm  we  shall  develop  requires  only  condition  (1.1).  However, 
we  shall  find  it  useful  to  make  certain  transformations  which  do  not  in  any 
way  limit  the  generality  of  this  procedure,  but  admit  a significantly  simpler 
derivation  of  the  important  results.  Consider  the  standard  technique  for 
transforming  lower  bound  restrictions  into  nonnegat i vi ly  constraints.  The 
usual  transformation; 
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X X - II 

I .1  I 


,1.) 


( . I) 


IS  iisi'il.  K(‘iil.i(«‘  X hv  its  ('(III  I v.i  I cut  X I II  ' II  whcicvi-i  x .iiiikmis.  Noli- 
.1  • ) .1  I 

that  x iiiav  then  lx*  i iit  (•ri>ti*t»‘(l  as  lh«‘  i lu  r(‘iiii‘iil  in  rxicss  ol  n assuiialiMl 
I ■ I 

with  the  value  x . 

J 

It  we  i-e-write  as  ‘ 

the  term  in  brackets  may  be  viewed  as  the  increment  in  resources  consumed,  in 
excess  of  e (u),  dut*  to  an  allocation  x"  in  excess  ol  ii  . Ihus , we  may 
denote  this  term  as  the  incremental  consumi>l  i on  timtion: 

0.  {2.2) 

‘ .1  .1 

Similarly,  under  (2.1)  we  also  obtain: 


r .(x  .)  = r .(x  .’  + 11.)  = |r.{x.)  - r . (u.)|  + r (ii  ), 
.1  .1  J .1  J .)  .1  .1  .1  ,1  .1 


Denote  the  bracketed  term  as; 


r'(x.')  r.(x.)  - r.(u.), 

J J J J .1-1 


,itJ, 


(2.3) 


the  incremental  return  over  r.(u.)  for  an  incremental  allocation  x.  over  u.. 

J -J  .1  .1 

Substituting  (2.1)  thru  (2.3)  into  (P)  yields  the  problem  (P  ): 


(P') 


1 r . (ii  . ) + max  i.  r ( x ' ) 

jr.J  ' ,jrJ  ' ' 

s.t.)  1 g'.(x.')  s b - 1 g (u.)  , 

Jf.J  *•'  ■'  ■ " •' 


ii'.l, 


0 < X ^ 11 


i 

< 

! 


X.  integer. 


where  u. 

J 


u . - u . . 
.1  -.1 


lid, 


Solving  the  equivalent  problem  (P  ) solves  (P),  but  now  g.".(x.’)  > ~ 

for  all  i and  j,  and  fj^®)  = 0 for  all  j. 
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()  V 1 .1  I III’  I II I I ii\i  I II); 


III  .lilil  I I I nil  , Wi’  ili.i\  ii'iliiir  till'  Si'(  III  .iillli  I I |i  1 1-  \ 


t ll  I I’l’  nlisi’  I V.l  I I IMIS 

li)  II,  lor  iiiy  I II,  lIuMi'  oxisls  soiin'  x.=»'  0 siu  li  lli.it  i M l' ) (I, 

\ lll’Cll  lll’Vl'l  I'llll.ll  f III  .III  llllillHIl  I il.l  t I’ll  SII  I III  I nil  . 

,1 

This  lollows  I roiii  the’  nlisiTV.il  ion  lli.il  .iiiy  soliilinii  iniil  .i  i ii  i ii>;  x .=i’  ^ 0 wonlil 

.ilw.iys  111'  iloiiii ii.itcil  hy . or  I'qii i v.i  1 ciil  lo,  llu'  s.iiiu'  solution  willi  x.  = t:  replacoil 

by  X.  0.  R«M  o^ni/«‘  Ih.il  il  w»'  ol  i iiiin.it o x^  = P I roin  i ons  iilor.it  ion,  llio 

rosiiltiiiK  re'iliicoii  rot  urn  Innolion  li.is  r (x  ) > 0 lor  .i  1 1 x ^0. 

.1  .1  .1 

(il)  II  tlioro  0X1  sis  .inv  | ' n with  x v.iliios  ( .iinl  i’  n"  siuli  lli.il: 

I .1 

1(1?')  " r(,n 


.111(1  j ^ ^ ' *^i  i 


I o r .1  1 1 I ! 1 , 


then  X.  nood  novor  oijnal  S in  .in  ninioiiiin.ilod  solution. 

This  lollows  I rom  thi'  t.iol  that  .iny  solution  ( out  .i  i n i iik  x . = I’  i s donnn.itod 

bv,  or  0(111  iva  lout  to.  I ho  saiiio  solution  with  x = t’  roiil.uod  hv  x.  = *.  i\ 

,1  • .) 

rodiK'lioii  mochaiiisni  oipiivaloiit  lo  (ii)  is  .ilso  providod  in  |18|. 

(iii)  11,  lor  any  j v n,  thoro  oxisls  somo  x.  = t’  > 0 snch  that  ' •' 

lor  at  loast  ono  if.l,  thou  no  to.isihlo  solution  ooiit  .i  i ii  iiik  x^  = C 
ox i St s . 

Ill  light  ol  Iho  lorogoiiig,  wilhonl  loss  ol  goiior.i  I 1 1 y . wo  sh.ill  lu’iioo- 
forth  assnmo  that: 


r.(x.)  > r^(0)  = 0 lor  x.  = 0.1,.... ii.. 


r.lx  ) ^ r.(0)  whoiiovor  x ''  0,  i ! .1 . 
.)  .1  .1  .1  •' 


I J . .4  ) 


In  addition. 


Rijlx.)  ^ = 0 lor  X.  = 0,l...,u^,  .iiid  all  i .iiid  i, 

and  thoro  oxisls  no  x..  jr..),  with  a v.iliio  ^ t.  jl,2...,n.}  salislying  tho 
condit ions  ol  I i i ) or  I i i i ) abovo. 


12.S) 


Lastly,  we  observe  that  the  v.tliie  ot  x ^ f may  be  vieweil  merely  as  an 
iililex  (leiioliiiK  the  a|i|i  i i>|m  i a ( e resoiiMe  veitoi 

iMn  = y1  

i onsiuiiei)  to  receive  a particular  level  ol  return  r^(J?)  I tom  variable  j. 
Consequently,  we  may  always  rede  tine  the  associated  index  valui's  lor  Xj  > 0 so 
as  to  reorder  the  VjtY)  vectors,  or  the  returns  1^1^),  into  any  convenient 
sequence.  Kecogiiize  that  (2.4)  and  (2.5)  are  unatfected.  Thus,  wherever 
convenient  we  may  also  assume,  again  without  loss  of  generality,  that; 

0 = r.(0)  s r^(l)  c •••  < ijlu.)  for  any  j = 1 , 2 , . . . , n . (2.7) 

The  conditions  of  conviMiience  in  (2.4),  (2.5),  and  (2.7)  need  not  be 
explicit  requirements  in  (P).  We  have  shown  that  only  the  far  weaker  knapsack 
condition  (1.1)  is  sufficient.  Thus,  tlii'  Moriii-Marsten  algorithm  in  |18|, 
which  assumes  (2.4),  (2.5),  and  (2.7)  hold  apriori,  in  fact  solves  a broader 
class  of  problems  than  originally  specified. 

3.  Recursions 

The  derivation  in  this  section  is  rel.ited  to  that  utilized  in  (bj,  (ll| 

and  (171,  and  details  an  approach  outlined  in  (16). 

£ 

Define  a set  of  n-vectors  of  the  form  Sj^  = (0,  0,...,  Xj^,  0,...,0)  as: 

^k  ^ ^■'^k  • "k*  ~ ' ’ • • • 

with  x.=0,  j^k,  jr.Jj , (3.1) 

tor  .ill  k = 1,2,...,  11 . 

Also,  define  a set  of  n-vectors  of  the  form  x|^  = (x^j,  xf’,...,  x||,  0,...,0)  as: 
-k  ' ^’'k  ■ ~ 0,1,. ..,P|^}  = {x  ; Xj  £ |0,l,...,Uj}  for  J k, 

with  x.=()  for  j > k,  jf.J),  (3.2) 

for  .ill  k = 1 , 2 , . . . , II . 

We  let  X {x^}  = {O}.  The  vector  x°  = 0 for  all  k = l,2,...,n.  The  value  P, 
= + 1)1  - 1. 
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S I nu  1 .1 1 I V , 


! t (x*  ) : |»=0,  I ....  ,1’,  i i I (x)  ; \ ) \ i 


•k  ' • ''k-l 


Vl'  i'k^  ^ 


,.I.  I th  K 


k-  I 


lot  .ill  k = 


Wr  lU'tnU'  K 


}rlx^^)i  JU{.  .Mso,  \,  li  .x  ; X},  .iiul 


K,  . K 
k - 


it(.x):  X j;  Xl  lor  .ill  k = I,J ii . 

Siiuo  u«'  aro  iiitoroslod  oiilv  iii  solutions  x i.  X that  aro  ItMsil'lo  tor 


(IM,  wo  loijuiro  .1  rulo  lor  olinnnatin>;  iiitoasil'lo  1 1 oms  I roiii  o.uli  X,  .-Xs 

K 


result . wo  also  roiluro  .iiul  Rj,  ai  oonliu^tly . Dotiuo  X^^  = {xj^  Xj^:  ^ * 


p=0.1 k=I.-...,n,  aiiil  lot  B,  .iiul  K.  ho  t ho  i oi  ii'sponiliii);  sots  ol 


ooiisumpt  toil  voi  tors  aiul  roturns.  I'loarlv  X,  X,  , B,  ^ B,  aiul  K,  C R,  . Aiul 

k k k-k  k~k 

siiu'o  RlO)  ^ h,  wo  havi'  X = X = iOj.  Kurt  liormoro,  X = X fx:  Rlx)  ^ h, 

o o n I o V 

o •'  X u.  X intoRor},  with  assooialoil  B = B ami  K = K ilt'liuoil  avconlingly . 


Tho  tol  lowing  rosult  jirovulos  Iho  rulo  lor  ilotormiiuiiR  which  olonionts  ot  X. 


can  ho  ol  iminatoil. 


t' 


Proposition  1:  I Koas  i hi  1 1 1 y lost)  tlivon  t'|._  | ■'  | 'Hul  r I tor 

V’ 


k=I.J,...,n,  it  ^ ^V-1  I'  ^ f’lii  tln’in'cro, 


' k+2  * * k*l 


Ififk.J  >"■'  * ',,-1  * 


sonu' 

|.,I  • U>14\, 

« IPlt  B..  = B. 


v!  v! 

Proof;  By  assumption  wo  havo  j r B|^_  | ami  r Ij^.  Suppose  that  = yj,  ♦ 


^ h IS  gone  rat  Oil.  By  ilotinition  t Bj^.  Now,  consiilor  I j.^  I • {f^i. 


tho  sot  ol  all  augmoiit.it  ions  goiior.itod  I rom  when  gonor.it  ing  I ■ Binco 


''  P tor  all  ' 0,  .ill  such  vectors  (>  + Yb*i  V ovory 


k+l 


f f {' «k+l^-  ' ktl  ® ^ \fl  ■'  Sinn  1.11  .irgiiniont  wo  sc'o 

■ • ' k.l  ♦ 


that  1^,,  • iy,|  •llWk,,  ..I  I„  • l„.|» 


Tho  proof  of  Proposition  1 .ilso  implies  tho  tol  lowing. 


i 

Corollary:  If  y^  + / B|^,  thou  tho  corrospomliiig  x^.  = s^^  + j f Xj^ 


Furthormoro.  • {xj  ^ X^^p  « {xj  4 •••  . ami  S.«  S. 


k+l 


k+l 


k + J’ 


n n 


• Sw^i  • X„  = X. 


Tin' rf  Jo  re, 


^ * Vi"  H-i, 


"k  - \ • "k-t''  Vr 


( l.ll) 


a ltd 


"k^  f'l  * ■ k'  • "k-i  '^S-r 


I'he  relat  lOiisJiips  C).6)  coinltined  with  J’roposition  1 provide  a mechanism 
for  recursively  generatiii)>  all  feasible  solutions  to  tl’),  while  also  providing 
the  associated  set  of  returns  and  consumption  vectors.  The  following  theorem 
provides  a recursive  mechanism  tor  identifying  .ind  ('liminating  vectors  from  Xj^ 
that  are  not  efficient. 

Let  X ^ X be  the  set  of  all  iind(>mi  n-it  ed , or  elficient,  solutions  for 

(!*)•  Define  = {x|^  t:  X^^  that  are  undomi natol i at  iter.itioii  k = 1,2,. ..,n. 

*V  ‘.V 

Then  X = X , and  X = X ; the  zero-vector  is  always  a member  of  the  efficient 
n o o 

set . 

Proposition  2:  (Elimination  by  Dominance) 

Given  x|^  f.  Xj^  and  xjj  c Xj^  for  some  k = l,2,...,n,  such  that  > (x|^)  ' * 

R(xj|)  g(x^),  then  dominates,  or  is  eipii valent  to,  x'||.  Consequently, 

• * Vi‘  •••  » Vi  « = >'*■ 

Proof;  Let  x^,  xjj  e Xj^,  and  suppose  that  ' ^ ' with  S(xj^)  '• 

g(x'||).  By  definit  ion,  x||  dominates,  or  is  at  worst  equivalent  to,  x'||  and 
therefore  x*||  t Xj^.  Consider  the  sets  # ^^k^  ^k+1  ® augmen- 

tations to  X|^  generated  from  x|^  and  x|J  at  iteration  k+1.  Let  I = sj|^^  + 

,9  f.  { 1 , . . . , I } • De  any  particular  c.indidate  solution  from  ® ^^k^' 

t’  ' II  C * 

= s,. , + xj.  However,  r(s. = 


-k  ^ h ’^ktl  * y ^k+l 


Then  there  exists  another  solution  x^^^  - 

g’  g ' g ' 

’^k+1  ' ^ ^k+l^*k+l^  ~ ^k+1  - ^ every  possible  value  of  g . Thus 

'■^’‘k^l'  = ' ‘k+l  * '■^’‘k^  = '•^’‘k+1  ^ 

and  g(xf^,)  = + glx[')  v ♦ glx'J)  = g(xj)^,). 


'k*I 


k*l 


k+1 
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' •'•‘I*  ^ ^ \ ♦ I ' ^ *' ■ **  ^ k*l  *'  *"**■•'•■'*’ I *■ » I ’•  *'li*iM- 

ii.ilcti  t I'oni  I'V  >li- 1 I II 1 1 I .>11 . Il  ll"‘ii  ^<>^{^',11  I'-  lliiis,  lln'  iMilir* 

si*l  # ix'||!  i.s  iloiiii  ii.iU-.l  tiy . or  ciiii  1 v.i  I onl  lo,  llic  set  nl  solutions  I 6t 

{x|^|.  rh«‘i «■  ( ot «• , * {x|||'a^  ^k*l'  '*  .M>;uiii<'Mt,  >>1.,  , # ‘"’ktl  * 

'"k*  ^ -"n  * ■'"n-l  * •••  * -"k.l  * i'^k*^  ^ = ^'11 

In  lin^'l  ot  I’l  opos  1 1 I on  2,  x'||  m.iy  I'o  .iroppo.i  1 tom  i ons  i.li'i  .it  ton  at  i ter. it  ions 

k , k* 1 , . . . , n . 

Wo  may  conihinc’  I ho  ahovo  tathoniin>>  i ritori.i  into  the  algoMt)in)  ontlinoil 
as  t »)  1 1 ows  : 

0.  Sot  k=0.  an.l  sot  X = R = R = iOi. 

o o o’’ 

1.  Set  k=k+l.  II  k ' n,  stop. 

2.  Sot  P = j B|,.j  ! *1.  ‘JikI  lahol  t tu'  ('It'iiK'iits  ol  ^ as  } , 

vitli  associalo.i  solutions  j = ix'  , x',...,  x^  } .ind  rolurns 

K^_,  = {rlx"),  r(x') rU*’U.  Sot  B^  = = X|^_|,  and 

k k- 1 
).  Lot  p = 0; 

4.  Lot  ^ = I ; 

5.  Lot  x = s^  + X*’,  with  cor rospond i nn  payot  I r = rj^  + r^x*'), 

^ 1) 

and  consumptions  |^  = \.  + P . 
b.  iFoasihi  1 ity  tost)  II  + p*’  \ h.  ^o  to  stop 
7.  iDominanco  tests) 


li)  It  X IS  dominated  by  a solution  cnrrontly  in  X.  , go 

K 

to  stop  O. 

Ill)  Il  X dominates  anv  solution  cnrrontiv  in  X,  , this 

k 

dominated  solution  m.iy  be  lathomi'd. 

8.  Sot  = B|^  V I {y‘+  Xj^  = X|^  u {xi,  and  = R|.  ^ { r } . 

9.  Sot  (?  = t’  ♦ 1 . 1 1 I?  ^ iij^,  go  to  stop  Otherwise, 

10.  Set  p = p + 1.  It  p s p,  j^o  to  stop  4.  Otherwise,  go  lo  step  1. 

At  termination,  X = X , the  sot  ol  .ill  nndominated  solutions  tor  IP). 


Tile  out  I MU'  |)io\ulcil  .tliiivc  i;.  virtu. illv  iil<‘utit.il  i o I Itr  |>  i oi  ciiu  i i'  out - 
111  ^2  ol  |IK|,  .1 1 ( lilt'  .1 1 ^oi  1 1 Inn  lit'io  li.i  i .i<l<i<-<|  llrxitiilily  in  th.it 

tlie  loops  on  p ainl  >i  may  !>»'  i nliTihauKc*!  il  ilos  i re<l . However,  our  <leve  1 opiiienl 
is  Haseil  on  only  the  most  tundamental  eonee|)ts  ot  reeiirsive  eiiiiinerat  i on  laid 
down  by  Bellip..:i  ll,2,-},4|,  Dantzig  l5),  Karush  ll2|,  Gilmore  and  Goniory  |9|, 
Kettelle  jn)  and  I.oane  115|,  utilized  in  the  later  work  of  Dreyfus  and 
Prather  (7j,  Greenberg  [10),  Lawler  and  Bell  jlA),  Nemhauser  and  Ullman  |19), 
Weingartner  [20-App.  A),  Weingartner  and  Ness  |21j,  and  Yormark  |22J,  and 
subsequently  formalized  and  extended  in  jll),  [16),  |17|,  |18|,  and  [23j. 

When  m = 1 we  have  essentially  the  Gi Imore-Goinory  procedure  of  |9|.  We  call 
this  type  of  derivation  an  imbedded  solution  space  approach.  It  again  makes 
clear  that  the  dimensionality  of  the  state  space  need  not  influence  the 
algorithmic  development.  Moreover,  this  approach  allows  for  simple  proofs  of 
Propositions  1 and  2,  and  also  admits  very  simple  proofs  of  the  results 
required  for  the  implementation  strategy  described  in  §4. 

4 . I m^l  ^eji  t at  i on 

Although  the  algorithm  of  §3  is  of  the  same  form  as  that  in  [18),  our 
approach  to  identifying  solutions  that  dominate  the  candidate  is  significantly 
different.  The  search  in  step  7 in  our  implementation  is  based  on  the  follow- 
ing concept.  Let  x be  any  candidate  solution  derived  from  progenitor  f.  B, 

K “ 1 


Q 1) 

at  step  5 of  the  algorithm,  with  p = + p*  . Define 

h ; max  [p ■ ) . 


14.1) 


Let  p be  the  resources  associated  with  some  alternative  feasible  solution 
x^  ^ X,  with  associated  maximum  element  h". 

Propositio^n  3:  If  p’  < p,  then  h"  < h. 

Proof:  By  hypothesis,  pT  < p^  for  all  i = l,2,...,m.  Then  h > p.  > p."  for  each 
i=l,2,...,m,  and  therefore,  in  particular,  for  that  (not  necessarily  unique) 
i = i for  which  pf.,.  = h obtains.)  | 
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Thus,  .my  solution  .x  wli  1 1 li  i .m  iloinin.itt*  t ho  i .in<l  i il.i  I o \ iiiiist  li.ivo  h 

it  \ tloiiiiii.it  os  sttiiio  soliiiitiii  s / X , thou  h ' li  . 

Wo  oxploit  I'l  o|it>s  1 1 I oil  i t>y  oiiv  I s I oil  1 11^  t ho  oloiiioiil;.  i>t  H (with 

K 

I'or  I os|>i>iiil  1 11^  li'lililis)  to  ho  III  iioiiiloi  I o.iN  I ily,  oiih‘1  ol  till'  .issoi  i.iloil 
l.iholiiig  III  stop  J thus  iiiiplios  h*  ' h*  p = l) , 1 , . . . , 1’ . Wo  t hot  k lt>i 
iloiiii  ii.iiit  o .it  stop  /(i)  iisiii^  t ho  lol  lowing;  ^•ll.lto^;y•  Aiiv  solution  x** 
tlttmi  ii.tl  1 11^  \ h.is  h'*  • h.  Siiito  ■ t' , tto  know  th.it  ti  li*  , hut  h** 
tl<l  .ill  (|  ' p .list).  Wo  .IVOItl  ox. III!  I II  I UK  x'*  ll>l  .ill  i|  ' p,  .Hill  III. I I lit  .1  I II 

hoiiiiil  i>ii  thosi'  x^^  th.it  iniKht  iloiiii  ii.it  o t ho  t .iiiil  i il.i  t o , hv  koopiiiK  t r.it  k 

iiiih'x  ij  toi  which 

h'^  = III  I II  {h'*  : rtx'*)  ‘ i '*  ■ i *’  = itx*’)i 

i|  t) 

oht.iiiis.  riioii  r**  ' I*  I toi  .ill  i|  ' !(,  .Hill  .iiiy  x'*  with  n ■ ij  o.iiuiot 
iloinin.ilo  X.  Suppose'  h"''  ' h ' li''’*^.  Hy  I’ropositioii  ^ only  oloiiioiits  i| , 4 •-  i|  ' 
lorri'spoiiii  to  solutions  which  m.iy  iloiiiiu.ilo  I ho  c .tmlul.it  o . I'ho  tost  ol  slop 
/(i)  IS  .ipplioil  only  to  sin  ti  i| ; li  r'*  ' 1,  wo  chock  to  soo  it  toi  .ill 

1=  1 ,2 , . . . ,m . This  row-wiso  so.irch  is  prooiiiptoil  .is  soon  .1.;  soiiio  ' (>.  . It  x 

IS  iiniloiiiinatocl  hy  .ill  4 ' n < s.  thoii  (t  is  "insoitoil"  into  Itj^. 

Dnoo  jt  IS  iiisoitoil  (.Hill  x s.ivoil),  wi'  must  oxooiito  stop  /’ ( 1 1 ) .iiul  c'x.imino 
those'  solutions  possibly  ilomin.iloil  hy  the'  ne'wly-.nhh'ii  x.  We'  .ivoul  se'.i  1 eh  1 iij, 
.ill  tho  e'h'iiie'nts  ot  Ii.iviiik  h'*  ''  h ihie'  to  the'  tollowiiiK  ii'siilt.  (A  simil.ii' 
ohsorv.it  ion  .ippo.irs  in  IlS)). 

1‘ropos  1 1 ion  4:  Any  solution  x'*  which  x ilomin.itos  h.is  .111  .issm' i .it  oil  p.iyol  t r'* 
such  lh.il  r**  ' 1'*  < I . 

Proot  ; Supposo  x ilonnn.itos  x'*  with  c ori  c'spoml  i n^  r*  ' 1*'.  Siiuo  is  in  H.  , 

K 

|l^’  \ ft‘*.  Then,  .illhotiKh  1 = r*’  * r||  ' i‘*,  wo  still  h.ivi'  (I  |t*’  + y||  \ (l'.*  | 1 


h Anil 

t ho  1 1 
h llle- 


.1  I I Kill 
ot  t h.it 


Wt'  store  Itie  il.it.i  tji'i  css.i  i y to  <‘xe<'iilc  I lie  <i  I got  i I liiii  iti  .1  ( wo-d  1 iiiens  1 oii.i  I 
array  Within  (dliiinn  J , al  i oin;)  I el  i oti  ol  iteration  k=  1 ,2  , . . . ,11: 

B(0,J)  eontains  the  reliirn  1*’  associated  with  some  solution  xj^’  i.  Xj^, 
B(I,J),  for  1=1, 2,..., Ill,  contains  the  ventoi  ft*’  assoi  iated  with  xj’, 
B(m+l,J)  cont.iins  the  h*^  associated  with  |5*’, 
and  B(,m+2,J)  contains  the  colnnin  number  corresponding  to 
In  addition, 

B(m+3,J)  contains  the  column  number  of  that  column  in  B(I,J)  with 
the  next  largest  return. 

The  link-list  B(m+2,J)  maintains  the  columns  of  the  B-array  in  nonderreas ing 
order  of  h without  requiring  them  to  actually  be  in  any  particular  physical 
order  in  the  computer  memory,  thereby  circumventing  the  data-liandl ing  problems 
of  inserting  new  vectors  into  B.  Whenever  h*'  = h*'^  \ we  order  such  that 
r*^  < r*^^' . That  is , 

B(m+l,p]  = B(m+1 ,B(m+2,p) I (4.2) 

implies  B(0,p)  < B|0,B(m+2,p) ) . 

The  link-list  B(m+3,J)  threads  the  columns  of  the  B-array  in  noiulecreas ing 
order  of  r.  If  two  undominated  solutions  have  equal  return, 

B|0,p)  = B|0,B(m+3,p) | 
implies  B|m+l,p|  < B(m+ I ,B(m+3,p)  | . 

Setting  B(m+2,J)  or  B(m+3,J)  to  1 denotes  that  there  are  no  successors  in  the 
associated  sequence. 

Storing  requires  .1  Imked-list  version  ot  the  standard  index-list 
common  to  dynamic  programming  implementations  (c.f.  |7l,  19),  llO),  or  122)). 

We  use  the  scheme  described  in  detail  in  II8),  and  not  repeated  here. 

We  need  not  choose  successive  progenitors  in  the  sequence  implied  by  step 
10  of  §3.  Having  examined  all  descendants  of  some  progenitor  c Xj^  j , it  is 

more  efficient  to  use  the  link-list  B{m+l,J)  to  find  that  f.  with  the 

next  largest  payoff.  Then  h*^  becomes  monotone  nondecreasing  over  the 
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siJt'ct'ss  I Vf  proxoin  t ors  .iii>l  1 1)>;  ij  is  liivi.il.  In  .nlil  1 1 i mi , >;ivi‘ii  .iiiy 

p.ittunlir  v.iliii'  <>l  l’  (I  Vvi'  iii.iy  >l('l  (‘nii  i iii'  .1  still  li^lili'i  imninl  loi  I lie 
tiomi  ii.tiM  .St  nil  III  sifp  /(i)  liy  liinlinx  I In-  iinlnx  i|"  sin  li  III. it 

l,‘»'  = III.  II  il,*'  ; i‘'  ■ * ill. 

<1  ■ tj 

It  t/^  ''  li , tluMi  X is  iiiitlonn  lint  ('ll  .mil  wn  iii'cil  only  npil.ilo  I ho  I ink- list 
B(m+2,.J).  In  ^oiit'rnl  h'*  < h .iinl  I h«'  il.it.i  iiooiioil  to  iipil.iti'  lt(in-t2,.J)  is 

obtniiu'il  iluring  tho  st  .111  in  stop  /li).  Note  thnt  it  t ho  rotiinis  s.itisty 
coiulition  (2.7),  ti'*  is  moiiotono  iioinloi  ro.is  1 n>>  in  t’  .mil  iipdnt  iiig  is  still  iiioro 
ot  t ioiont . 

Kol  lowing  Proposition  4,  in  stop  7(ii)  wo  oxniiiini'  only  solutions  with 
pnyotts  hotwoon  r^*  .iinl  1 hy  tol  lowing  tho  I ink- list  lUn'+l,-)).  Stnrting  I roin 
tho  progonitor,  wo  sonn  tho  olonionts  ot  tht'  B-.irry  in  nondt'orons ing  oriior  ot 
payott,  oxnmining  for  doininniuo  thost'  with  l/*  '•  h and  rotnrii  r'*  < r.  Wo  stop 
immodiatoly  upon  enoountoring  .in  olomont  ((  whoso  rt'liirii  r**  ^ r.  Wo  llio/i 
updato  B(ni+3,.))  without  additional  soarch. 

This  last  procoduro  can  ho  improved  hy  rocognixing  lh.it  t'lt'im'iils  tj  ^ s 

with  ti'*  s h,  oxaniinod  previously  in  stop  7(i),  nood  novor  ho  ro-oxaminod  in 

step  7(ii).  During  the  stan  of  stop  7(i),  wo  (.111  o.isily  keep  track  ot  th.it 
column  J = j corresponding  to  m.ix  { r**  s r ; h**  < h ; tj  ^ H s s ! . Wo  then 
initial  i/e  the  scan  in  step  7(ii)  at  column  B(m+,1,  j ). 

When  u.  = 1 for  all  j < n,  the  entire  algorithm  is  ottt'ii  more  ollicioiit 
if  tho  variables  are  renumbered  such  that: 

r.Cn/lr’  > r.^|(l)/h''^',  .j  = l,2 n-1.  (4..I) 

when'  h*  - max  ig..(l)}.  This  is  exactly  .in.ilogons  to  tho  "h.iiig- 1 or-t ho-huck" 
i ' 

ordering  common  to  knapsack  algorithms.  When  m = 1,  ot  course,  both  orderings 
must  be  identical. 

When  11.  > 1,  a natural  extension  ot  this  idea  is  to  rt'-ordor  the 
.1 

2-values,  within  a specified  j < 11,  such  th.il: 

-1,1- 


I (V’)/h  '( V’)  I ( I'*  I )/ll  '(  I'l  I ),  (/|./«  ) 

I .1 


‘'=1,2 .1^-1, 

wlicrc  li ' ( V ) iii.ix  Ik  ^ ( Ir' ) I . Tlifii,  I lie  v.i  r i .ili  I c;:  .i((<iii|iiik  1 o (4.  5). 

The  use  ol  h as  an  ordering  erilerion  is  an  .itli'mpl  lo  lind  a snilahle 
surrogate  tor  the  vectors  P that  is  both  effective  in  identifying  potentially 
dominating  columns,  but  avoids  examining  individual  components  wherever 
possible.  The  ordering  scheme  embodieil  in  Proposition  d,  however,  is  surpris- 
ingly robust  in  the  sense  that  there  are  alternative  surrogates  for  P (see 
I2'll  for  example)  which  will  also  satisfy  the  proposition.  While  (4.1)  is 
always  vali<l,  an  alternative  is  to  define 


h=min{p.}.  (4.5) 

i 

It  is  easy  to  see  that  the  relationship  in  Proposition  3 is  maintained  under 
(4.5).  Moreover,  the  entire  implementation,  and  the  ordering  of  variables  via 
(4.3)  and  (4.4),  remains  exactly  as  described  above,  except  that  h is  now 
computed  using  (4.5). 

The  rule  (4.1)  looks  to  insert  the  new  candidate  "far"  from  its  pro- 
genitor p because  the  ordering  is  on  the  largest  element  in  p.  Thus,  the  scan 
in  step  7(i)  may  become  unnecessarily  long.  By  ordering  on  the  smallest 
element  in  § we  keep  these  scans  "short",  since  relatively  fewer  potentially 
dominating  columns  qualify  under  Proposition  3.  Unfortunately,  (4.5)  need  not 
be  a uniformly  better  choice.  In  problems  with  a low  density  of  nonzero 
entries  in  the  consumption  function  tables,  the  h values  under  (4.5)  are 
frequently  zero.  This  can  result  in  extended  sequences  of  columns  with  equal 
h values  of  zero.  Then,  the  dominance  scans  in  step  7(i)  can  have  more 
frequent,  expensive  row-wise  comparisons.  Rule  (4.1)  avoids  this  problem  and 
is  preferred  in  such  cases.  For  problems  with  a low  density  of  nonzero 
elements  in  the  consumption  function  tables,  however,  (4.5)  is  usually  supe- 
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rior  to  (4.1).  Capit.il  iiig  prol>l(‘ins  are  a prime  example  ol  siiih  a 

class.  Many  of  the  lest  problems  listed  in  |18|  are  capit.il  budgeting  models. 

The  reaiier  familiar  with  the  Monn-M.irsteii  prniediire  will  recogniz<-  that 
the  implementation  here  i an  be  exp»*i  led  to  be  more  elliiiciit  tli.in  Ih.il  in  |IK| 
when  m and  n are  of  realistic  size.  The  Mor in-Marslen  procedure  maintains  an 
array  of  m link-lists  (called  PKHMUTK;  s«'e  | 18  - p.II‘)2|),  one  for  each  con- 
straint. These  thread  the  corresponding  jt*’ , p=(),  1 , . . . ,P,  in  nondecreasing 
order.  All  m link-lists  must  be  scanned  over  all  |l'*,  (1*^  < P*.*  |1.  , every  time 

a candidate  is  added  to  the  B-list  in  ordi'r  to  iipdalt'  e.u  b row  of  PERMUTK  for 
the  next  scan.  Moreover,  as  m increases,  this  computational  burden  increases 
at  least  linearly.  Our  implementation  maintains  but  a single  link-list  for 
the  equivalent  scan,  regardless  of  the  v.iliie  of  m.  And  updating  of  this  list 
is  implicit  to  the  algoritlim. 

Finally,  we  note  that  each  column  of  the  B-array  requires  m+4  words  of 
central  memory,  excluding  additional  locations  needed  to  store  the  associated 
solutions.  As  dominated  columns  are  dropped,  all  these  locations  can  be 
re-used.  Such  "empty"  columns  are  recycled  in  a FIFO  manner,  before  the 
active  length  of  B is  extended,  as  in  the  implementation  ol  Il8l.  However, 
the  algorithm  in  (18|  requires  2m+2  words  of  memory  per  column  excluding 
locations  needed  only  to  save  the  undominated  solutions.  Consequently, 
(m-2/m+4)=75'5(,  more  storage  is  required  than  with  our  approach  when  m is  as 
small  as  20.  This  can  be  important  when  the  number  of  constraints,  or  the 
number  of  undominated  strategies,  is  large. 

b.  An  Example 

To  illustrate  the  implementation  strategy  of  S4,  we  have  developed  a 
small,  but  highly  nonlinear  samnle  problem  in  n=d  variables  with  m=2 
constraints.  The  raw  data  for  the  return  and  consumption  functions  are  given 


in  Figure  1(a).  Note  that  ii-(  1,2,0)  and  u=  (r),5,3),  with  h={2,‘i‘-s) ' . After 
applying  (2.1),  we  obtain  the  revised  functions  (2.2)  and  (2.3)  listed  in 


Figure  1(b).  Note  that  now  u"  = (0,0,0),  u'  = (4,3,3),  and  b'  = (.“i,  fiy  . By 
(i)  of  §2,  we  may  ignore  Xj’  = 2,  and  via  (ii)  of  § 2 we  may  ignore  x^  = 2. 

Thus,  in  Figure  1(c)  we  have  listed  the  equivalent  functions  with  these 
columns  deleted  and  the  admissible  x^  adjusted  accordingly.  In  Figure  1(d)  the 
data  have  been  re-ordered  according  to  (4.3)  and  (4.4). 

At  the  end  of  iteration  k=l,  the  B-array  appears  in  main  memory  exactly 
as  shown  below.  Column  niunbers  and  labels  are  for  convenience  only. 


Row 


1 

2 

3 

4 

0 

0 

4 

2 

2.5 

1 

0 

3 

2 

1 

2 

0 

2 

2 

3 

3 

0 

3 

0 

3 

4 

3 

1 

4 

2 

5 

3 

1 

2 

3 

1 

2 

®1 

^1 

The  array  below  is  the  B-array  above  listed  according  to  the  link  list 
B(m+2,J)  = B(4,J).  Note  the  h values  in  B(m+l,J)  are  now  in  nondecreasing 
order. 


Row 


1 

3 

4 

2 

0 

0 

2 

2.5 

4 

1 

0 

2 

1 

3 

2 

0 

2 

3 

2 

3 

0 

2 

3 

3 

4 

3 

4 

2 

■ 

1 

5 

3 

2 

1 

bO 
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l.i)  Ori^Mi.il  D.U.J 


•'1 

0 

1 

) 

f 

*4 

0 

1 

■) 

\ 

0 

4 

« ') 

2^ 

2 

0 

i 

1 

2‘j 

0 

.f 

4 

1 

2 

0 

) 

2‘i 

0 

> 

) 

2 

0 

i 

4 

> 

•^.l  .1 

(»>) 

Data 

Undo  r 

(2. 

1 ) 

0 

1 

> 

.] 

0 

1 

) 

r 4x,) 

0 

4 

j'j 

) 

0 

2'i 

.1 

f .1 

K./x,) 

0 

i 

> 

0 

1 

> 

0 

> 

> 

0 

) 

.1 

ratio  (4.4) 

1 .i 

.8i 

1.0 

.8^ 

1.0 

Data 

RoOiut'ti  Vi.i 

llomiuaiur 

"l 

0 

1 

•> 

.)  0 

1 

> 

,1 

0 

4 

2 

2';  0 

1 

2'i 

l‘i 

«,/X^l 

0 

) 

> 

1 0 

> 

2^ 

1 

0 

•> 

2 

.1  0 

2^. 

ratio  14.4) 

1 ..) 

1.0 

.8.1 

1.2 

1.0 

1.0 

(.0 

Data 

Oide'iod  By 

i4..n 

aiui 

l4 . 4 ) 

Figure  1.  Data  for  the  Kxample  I’roblom 


To  illuslratt*  .1  iii.i  lor  1 iit  or  .il  1 on  k = .'  .it  (lie  |ioin(  when' 

wo  art'  jhout  to  (‘iitr'r  (j  oI  (Ik*  .1 1 ^oi  i ( hiii  with  t ho  |ii  o^cii  1 tor  hoiii>;  |t‘|  .mil 

) 

t - 2.  Tho  progiMiitoi  (>‘1  IS  storoil  in  oulniiin  ^4.  Tlio  1 01  1 o.s|ion<l  1 n>;  H-.iir.iy  is 

I ) 

listoil  h(‘low  in  h onlor,  .iIoiik  with  tho  < .iml  1 d.it  o |t  • y*,  1 |t'|  with  p.iyol  I 1 

S. 


Row 


1 

3 

6 

5 

4 

2 

7 

9 

8 

10 

0 

0 

2 

2.5 

3 

2.5 

4 

3.5 

4.5 

5 

5.5 

1 

0 

2 

2.5 

2 

1 

3 

1 

4.5 

4 

3 

2 

0 

2 

1.5 

2.5 

3 

2 

3.5 

3.5 

4.5 

5.5 

3 

0 

2 

2.5 

2.5 

3 

3 

3.5 

4.5 

4,5 

5.5 

1 

4 

3 

6 

5 

4 

2 

7 

9 

a 

10 

1 

5 

3 

6 

4 

7 

5 

9 

2 

8 

10 

1 

^1 

1 

0 „1  „2  „3  3 


= _r 

= 11 
= h 


3.5 

4.5 


4,5 


We  refer  to  this  array  in  the  following  discussion. 

From  the  prior  cycle  with  pj,  the  value  h*^  = 2.5  corresponded  to  column 

6,  Since  the  payoff  in  column  6 is  now  not  greater  than  the  letiirn  found  in 
2 

the  Pj  column,  we  search  "to  the  right"  from  column  6,  finding  that  the 
updated  h^  is  in  column  5.  We  also  note  that  the  candidate  is  feasible.  We 
thus  search  "to  the  right"  from  column  5 stopping  at  column  8,  the  column 
corresponding  to  h*^  = 4.5;  column  8 contains  the  "leftmost"  potentially 

dominating  solution.  All  other  columns  "between"  5 and  8,  with  h values  no 
larger  than  h = 4.5,  are  eliminated  by  value.  F.xamining  column  8 more 
closely,  we  test  the  elements  row-wise  against  p.  Since  B(l,8)  = ^ ^ Pj  = 3^, 
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w('  m.'y  I molt'd  I .*  t I y i <>iii  linlc  th.it  coluiiiii  K t.iniiot  doim  ii.it  <-  the  t .mil  i d.il  c , .iiid 


prft'inpt  thf  t'ht'ck  ol  row  J.  Kiirtherniort',  .siiut*  B(iii+l,10)  “ S's  ‘ li  = 4*t,  stt'p 
7(i)  IS  t'Dinpleted,  tht*  r.uidnl.it('  is  undomiiKitpd , jiid  is  to  be  "iiist'rted 
betwt'pn"  rohunns  4 .iiul  H iii  ordt'i  to  honor  (4.2). 

During  step  7(i)  wo  keep  track  ol  column  vl=j-''  containing  the  greatest 
lower  hound  on  r such  that  B(ni+l,j*)  s h.  This  is  column  j-  = 7.  Thus, 
starting  at  column  B(m+3,,j")  = B(.‘>,7)  = 2,  we  quickly  trace  through  the 
payoffs  via  .md  determine  th.it  column  9 holds  the  smallest  payoff 


among  all  columns  with  B(m+l,J)  ■ h.  .Starting  here  we  check  il  the  candidate 
dominates  column  9.  It  cannot,  since  |1 , > B(2,9).  Now,  B(m+3,9)  leads  us  to 
column  8.  Since  B(m>l,8)  ^ h and  8(0,8)  = r,  we  must  check  again  for  domi- 
nance. We  disco  er  that  column  8 is  dominated  by  the  candidate,  and  thus  can 
he  fathomed  immediately.  Kurthermore,  B(m+.1,8)  leads  to  column  10  where 
B(0,10)  > r.  Therefore,  we  i-.in  stop  the  search  here,  and  step  7 (ii)  is 
completed.  The  updated  .irray  appears  below,  listed  in  h order.  The  candidate 
has  replaced  the  old  fathomed  column  8. 
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